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AMENDMENTS TO THE CLAIMS 



1 . (Currently Amended) A method comprising: 
receiving electronic ink input; 

generating a list of machine-generated text candidates based on the electronic ink input, 
the list including a first machine-generated text candidate and alternative machine-generated text 
candidates; 

converting the electronic ink input to the first machine-generated text candidate; 
displaying the first machine-generated text candidate; 
receiving speech input; 

converting the speech input to second machine-generated text, wherein the second 
machine-generated text is one of the alternative machine-generated text candidates and the list of 
machine-generated text candidates functions as a dictionary used for converting the speech input 
pursuant to a statistical language model, to generate for every instance of a spoken word dt_ in the 
dictionary, the similarity between dt and list of machine-generated text candidates w;j being 
represented as a function defined as the logarithmic value of a count of the matched characters 
w y, dk _ divided by a value of the sum of the length of Wjj and d£ 

analyzing when the string similarity between dk and is very small, including the 
optimum constraint, with dk being completely discounted as a candidate of w L for converting the 
speech into text ; and 



replacing the first machine-generated text candidate with the second machine-generated 

text. 

2. (Original) The method of claim 1 , wherein the first machine-generated text candidate is a 
word. 

3. (Original) The method of claim 1, wherein the first machine-generated text candidate is a 
portion of a word. 
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4. (Original) The method according to claim 1 , further comprising receiving input selecting 
the first machine-generated text candidate prior to receiving the speech input. 

5. (Original) The method according to claim 4, wherein the selecting includes touching a 
user input device to a digitizer screen at a location corresponding to the first machine- generated 
text candidate. 

6. (Original) The method according to claim 4, wherein the first machine- generated text 
candidate is a group of words or part of a word. 

7. (Original) The method according to claim 1, further including displaying the list of 
machine-generated text candidates prior to receiving the speech input. 

8. (Original) The method according to claim 7, wherein said step of displaying the 
alternative machine-generated text candidates further includes displaying the alternative 
machine-generated text candidates in the list in an order based on a confidence level that each 
alternative machine-generated text candidate corresponds to the electronic ink input. 

9. (Original) The method according to claim 1 , wherein the alternative machine-generated 
text candidates include machine-generated text candidates based on the electronic ink input 
generated by a handwriting recognition engine, 

10. (Canceled). 

11. (Original) The method according to claim 40_J_, further comprising displaying the 
machine-generated text candidates generated by the handwriting recognition engine and 
subsequently displaying the machine-generated text candidates generated in accordance with the 
statistical language model. 
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12. (Original) The method according to claim 11, further comprising receiving input 
requesting the display of the machine-generated text candidates generated in accordance with the 
statistical language model while displaying the machine-generated text candidates generated by 
the handwriting recognition engine. 

13. (Original) The method according to claim 1, wherein the alternative machine-generated 
text candidates include text candidates based on the electronic ink input generated by a statistical 
language model. 

14. (Original) The method according to claim 1, wherein the step of converting the speech 
input to the second machine-generated text includes 

determining if the speech input corresponds to one of the alternative machine-generated 
text candidates; and 

converting the speech input to the corresponding alternative machine-generated text 
candidate when the speech input corresponds to the alternative machine-generated text candidate. 

15. (Original) The method according to claim 1, wherein further comprising the step of 
receiving an input confirming that the second machine-generated text candidate should replace 
the first machine-generated text candidate prior to performing said step of replacing. 

16. (Original) A computer-readable medium including computer-executable instructions 
stored thereon for performing the method of claim 1 . 

17. (Currently Amended) A method for recognizing an input, comprising; 
receiving electronic ink input; 

generating a list of machine-generated objects based on the electronic ink input, the list 
including a first machine-generated object and alternative machine-generated objects; 
converting the electronic ink input to the first machine-generated object; 
displaying the first machine-generated object; 
receiving speech input; 
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converting the speech input to a second machine-generated object, wherein converting of 
the speech input is performed based on the list of machine-generated objects and wherein the 
second machine-generated object is one of the list of machine-generated objects pursuant to a 
statistical language model to generate every instance of a machine-generated object functioning 
as a dictionary, the similarity between the dictionary and the list of machine- generated objects 
being represented as a function defined as the logarithmic value of a count of the matched 
characters divides by the value of the sum of the length of machine-generated objects and every 
instance of the machine-generated object functioning as the dictionary, and analyzing when the 
string similarity between the length of machine-generated objects and every instance of the 
machine-generated object functioning as the dictionary is very small, including the optimum 
constraint, with every instance of the machine- generated object functioning as the dictionary 
being completely discounted as a candidate of the list of machine-generated objects for 
converting speech into text ; and 




replacing the first machine-generated object with the second machine- generated object 
when the second machine-generated object is different from the first machine- generated object. 

18. (Original) The method according to claim 17, further comprising the step of receiving 
input confirming that the second machine-generated object should replace the first machine- 
generated object prior to performing said step of replacing. 

19. (Original) The method according to claim 17, further comprising receiving input 
selecting the first machine-generated object prior to receiving the speech input. 

20. (Original) The method according to claim 17, further comprising displaying a list of 
alternative machine-generated objects on the display prior to receiving the speech input. 

21. (Original) The method according to claim 20, wherein said step of displaying the 
alternative machine- generated objects further includes displaying the alternative machine- 
generated objects in the list in an order based on a confidence level that each alternative 
machine-generated object corresponds to the electronic ink input. 
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22. (Original) The method according to claim 17, wherein the alternative machine-generated 
objects include objects based on the electronic ink input generated by a handwriting recognition 
engine. 

23. (Canceled). 

24. (Currently Amended) The method according to claim 23 - 17 , further comprising 
displaying the machine-generated objects generated by the handwriting recognition engine and 
subsequently displaying the machine- generated objects generated in accordance with the 
statistical language model. 

25. (Original) The method according to claim 24, receiving input requesting the display of 
the machine-generated objects generated in accordance with the statistical language model while 
displaying the machine-generated objects generated by the handwriting recognition engine. 

26. (Original) The method according to claim 17, wherein the alternative machine-generated 
objects include machine-generated objects based on the electronic ink input generated by a 
statistical language model. 

27. (Original) The method according to claim 17, wherein the step of converting the speech 
input to the second machine-generated object includes 

determining if the speech input corresponds to one of the alternative machine-generated 
objects; and 

converting the speech input to the corresponding alternative machine-generated object 
when the speech input corresponds to the alternative machine-generated object. 

28. (Original) A computer-readable medium including computer- executable instructions 
stored thereon for performing the method of claim 17. 
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29. (Currently Amended) A system comprising: 
a display; 

a first input adapted to receive electronic ink input; 
a second input adapted to receive speech input; and 

a processor programmed and adapted to: (a) convert the electronic ink input to first 
machine-generated text using handwriting recognition; (b) display the first machine-generated 
text on the display; (c) convert the speech input to second machine-generated text using speech 
recognition; (d) generate a list of machine-generated text candidates based on the electronic ink 
input, the list including a first machine-generated text candidate and alternative machine- 
generated text candidates and pursuant to a statistical language model to generate every instance 
of an alternative machine-generated text candidates functioning as a dictionary, the similarity 
between the dictionary and the list of alternative machine- generated text candidates being 
represented as a function defined as the logarithmic value of a count of the matched characters 
divides by the value of the sum of the length of alternative machine-generated text candidates 
and every instance of the alternative machine- generated text candidate functioning as the 
dictionary, and analyzing when the string similarity between the length of alternative machine- 
generated text candidates and every instance of the alternative machine- generated text candidate 
functioning as the dictionary is very small, including the optimum constraint, with every instance 
of the alternative machine- generated text candidate functioning as the dictionary being 
completely discounted as a candidate of the list of alternative machine-generated text candidates 
for converting speech into text and functioning as a dictionary for converting the speech input; 
and (e) replace the first machine- generated text candidate with the second machine-generated 
text. 

30. (Original) The system according to claim 29, wherein the first machine-generated text is 
a word. 

31. (Original) The system according to claim 29, wherein one of the first or second inputs is 
adapted to receive a confirmation input that the second machine-generated text is correct before 
replacing the first machine-generated text with the second machine-generated text. 
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32. (Original) The system according to claim 29, wherein the first input is further adapted to 
receive a selection of a portion of the first machine-generated text for correction. 

33. (Original) The system according to claim 32, wherein the selected portion is the entire 
first machine-generated text. 

34. (Original) The system according to claim 29, wherein said processor is further 
programmed to display the alternative machine-generated text candidates on the display prior to 
the second input receiving the speech input. 

35. (Original) The system according to claim 29, wherein said processor is further 
programmed to display the alternative machine-generated text candidates on the display in an 
order in the list based on a confidence level that the respective alternative machine-generated text 
candidate corresponds to the electronic ink input. 

36. (Original) The system according to claim 29, wherein said processor is programmed to 
generate the alternative machine-generated text candidates based on the electronic ink input 
using a handwriting recognition engine. 

37. (Canceled). 

38. (Currently Amended) The system according to claim 3? 29, wherein the first input is 
further adapted to receive a request to display the machine-generated text candidates generated in 
accordance with the statistical language model while displaying the machine-generated text 
candidates generated by the handwriting recognition engine. 

39. (Original) The system according to claim 29, wherein said processor is programmed to 
generate the alternative machine-generated text candidates based on the electronic ink input 
using a statistical language model. 
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40. (Original) The system according to claim 29, wherein said processor is further 
programmed to determine if the speech input corresponds to one of the alternative machine- 
generated text candidates; and convert the speech input to the corresponding alternative machine- 
generated text candidate when the speech input corresponds to the alternative machine-generated 
text candidate. 

41 . (Currently Amended) A system for recognizing an input, comprising: 
a display; 

a first input adapted to receive an electronic ink input; 
a second input adapted to receive speech input; and 

a processor programmed and adapted to: (a) convert the electronic ink input to a first 
machine-generated object using handwriting recognition; (b) display the first machine- generated 
object on the display; (c) generate a list of machine-generated objects based on the electronic ink 
input, the list including the first machine-generated object and alternative machine-generated 
obj ects pursuant to a statistical language model to generate every instance of an alternative 
machine-generated objects functioning as a dictionary, the similarity between the dictionary and 
the list of alternative machine-generated objects being represented as a function defined as the 
logarithmic value of a count of the matched characters divides by the value of the sum of the 
length of alternative machine- generated objects and every instance of the alternative machine- 
generated object functioning as the dictionary, and analyzing when the string similarity between 
the length of alternative machine-generated objects and every instance of the alternative 
machine-generated object functioning as the dictionary is very small, including the optimum 
constraint, with every instance of the alternative machine-generated object functioning as the 
dictionary being completely discounted as a candidate of the list of alternative machine- 
generated objects for converting speech into text and ; (d) convert the speech input to a second 
machine-generated object using speech recognition, wherein the conversion of the speech input 
is performed based on the list of machine-generated objects and wherein the second machine- 
generated object is one of the list of machine-generated objects; and (e) replace the first 
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machine-generated object with the second machine-generated object when the second machine- 
generated object is different from the first machine-generated object. 

42. (Original) The system according to claim 41 } wherein one of the first or second inputs is 
adapted to receive a confirmation input that the second machine-generated object is correct 
before replacing the first machine- generated object with the second machine-generated object. 

43. (Original) The system according to claim 41, wherein said processor is further 
programmed to display the alternative machine-generated objects on the display prior to the 
second input receiving the speech input. 

44. (Original) The system according to claim 41, wherein said processor is programmed to 
generate the alternative machine-generated objects based on the electronic ink input using a 
handwriting recognition engine. 

45. (Original) The system according to claim 44, wherein said processor is programmed to 
generate the alternative machine-generated objects based on the electronic ink input using a 
statistical language model. 

46. (Original) The system according to claim 45, wherein the first input is further adapted to 
receive a request to display the machine-generated objects generated in accordance with the 
statistical language model while displaying the machine-generated objects generated by the 
handwriting recognition engine. 

47. (Canceled). 

48. (Original) The system according to claim 41, wherein said processor is further 
programmed to determine if the speech input corresponds to one of the alternative machine- 
generated objects; and convert the speech input to the corresponding alternative machine- 
generated object when the speech input corresponds to the alternative machine-generated object. 
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49, (New) The method of claim 1 , wherein the speech input operates pursuant to a statistical 
language model, to generate for every instance of a spoken word £& in the dictionary, the 
similarity between dk and list of machine-generated text candidates wy is defined as 



with a Cmatch (wij, dk) being the count of the matched characters between d k and w w - (considering 
order), the lenfwij is the character count of word Wjj, and the len(dk) is the character count of 
word dk, where the statistical score of dk in string similarity is defined as 

s s!m (d k ) = max(s sim (d k , w, ; )) 

analyzing when the string similarity between dk and w y is very small, including the 
optimum constraint, with <4 being completely discounted as a candidate of w t - for converting the 
speech into text; and 

replacing the first machine-generated text candidate with the second machine-generated 

text. 

50. (New) The method of claim 17, wherein the speech input operates pursuant to a statistical 
language model, to generate for every instance of a spoken word dkin the dictionary, the 
similarity between dk and list of machine-generated text candidates w;j is defined as 



with a Cmatch dk) being the count of the matched characters between dk and w v - (considering 
order), the len(w ifj ) is the character count of word w iJt and the len(dk) is the character count of 
word dk, where the statistical score of dk in string similarity is defined as 
s slm (d k ) = max(s sim (d k ,w iJ )) 

analyzing when the string similarity between dk and w v - is very small, including the 
optimum constraint, with dk being completely discounted as a candidate of w,- for converting the 
speech into text; and 
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replacing the first machine-generated text candidate with the second machine-generated 

text. 

51 . (New) The method of claim 29, wherein the speech input operates pursuant to a statistical 
language model, to generate for every instance of a spoken word dkin the dictionary, the 
similarity between d k and list of machine-generated text candidates Wy is defined as 



with a c maSc h (wij, dk) being the count of the matched characters between dk and wy (considering 
order), the len(wij) is the character count of word wy, and the len(dk) is the character count of 
word dk, where the statistical score of d k in string similarity is defined as 
s slm {d k )=mw{s sim {d k ,w UJ )) 

analyzing when the string similarity between dk and wy is very small, including the 
optimum constraint, with dk being completely discounted as a candidate of w t for converting the 
speech into text; and 

replacing the first machine-generated text candidate with the second machine-generated 

text. 

52. (New) The method of claim 4 1 , wherein the speech input operates pursuant to a statistical 
language model, to generate for every instance of a spoken word d k in the dictionary, the 
similarity between dk and list of machine-generated text candidates wy is defined as 



with a Cmatch (w t j, being the count of the matched characters between d k and wy (considering 
order), the len(wij) is the character count of word Wy, and the len(dk) is the character count of 
word dk, where the statistical score of dk in string similarity is defined as 





s sim (d k ) = mdx(s slm {d k ,w tJ )) 
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analyzing when the string similarity between dk and Wy is very small, including the 
optimum constraint, with d k being completely discounted as a candidate of w* for converting the 
speech into text; and 

replacing the first machine-generated text candidate with the second machine-generated 

text. 
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